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| We provide Lyapunov-like characterizations of positive invariance, boundedness 

and convergence of non-trivial solutions for a class of systems with unstable in- 
1—1 1 variant sets. The systems of this class comprise of a stable part coupled with a 

one-dimensional unstable or critically stable subsystem. Examples of these systems 
Q ■ appear in the problems of nonlinear output regulation, parameter estimation and 

■ adaptive control. We demonstrate that, for a large class of systems with unstable 

equilibria and solutions that might escape to infinity in finite time, it is always 
possible to determine simple criteria for positive invariance and boundedness of the 
system's nontrivial solutions. Conversely, it is possible to characterize domains of 
! initial conditions that lead to solutions escaping from the origin. In contrast to 

other works addressing convergence issues in unstable systems, our results do not 
rely on the availability of input-output gains or contraction rates that are usually 
I/-) . required for the stable compartment. 
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: 1 Introduction 

The analysis of asymptotic properties of dynamical systems is an important component 
of modern control theory. Even though the problems of control are often viewed as 
that of synthesis rather than analysis, the latter crucially affects the former. Indeed, in 
order to be able to specify feasible goals of synthesis, e.g. forward-completeness, state 
boundedness, asymptotic convergence of solutions to a region in the state space etc., one 
needs to understand how these properties depend on the system parameters and controls. 

The majority of the analysis techniques in control, and hence methods for systems 
design, rely upon presumption that desired motions in the system are to stable in the 
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sense of Lyapunov [7j. Let us briefly remind this and other related notions from the 
domain of dynamical systems. 

Consider a flow x(t, Xq) : K. x M. n — > W 1 . A set S is invariant w.r.t. x(t, Xq) iff 
xo G 5 =>■ a;(t,x ) G 5 for all t G 1 A set S is positively (forward) invariant iff 
x(to,x ) G 5 =>- a?o) G 5 for all t > t . Unions and intersections of a family of 
(positively) invariant sets are (positively) invariant. A closed invariant (w.r.t. the flow 
x(t, xo)) set S is stable in the sense of Lyapunov if for any neighborhood V of S there exists 
a positively invariant (w.r.t the flow x(t, xq)) neighborhood W of S such that W C V 
|24j . In other words, a set that is stable in the sense of Lyapunov has a fundamental bas^\ 
of positively invariant neighborhoods. 

The notion of Lyapunov stability and analysis methods that are based on this notion 
are proven successful in a wide range of engineering applications including the problems of 
regulation, tracking, state observation [13], [5], identification [5] and adaptation [T2] , [TU] . 
The popularity and success of the concept of Lyapunov stability resides, to a substantial 
degree, in the convenience and applied utility of the method of Lyapunov functions. 
Indeed, instead of explicit computation of solutions of an ordinary differential equation 
(ODE) it suffices to solve an algebraic inequality involving partial derivatives of a given 
Lyapunov candidate function. 

Yet, as the methods of control expand from purely engineering applications into wider 
areas of science, there is a need for maintaining behavior that fail to obey the usual notion 
of uniform Lyapunov stability [19] , [20] . Even though solutions of these systems may not 
be uniformly asymptotically stable (or even become unstable), they are required to be 
bounded. 

In this paper we propose an extension of the classical Lyapunov function method that 
allows to address the issues of boundedness and convergence to invariant sets for a rich 
family of systems of which the solutions may not be uniformly asymptotically stable. 
Below we provide two examples of systems from this class that appear in the context of 
control and estimation problems. 

Example 1 Nonlinear output regulation in presence of uncertainties. The studied question 
is as follows. Let the following system be given 

x = f(x, t) + g(x, t)u, / :l"xi^l n , 9 :rxl^R m 

y = h(x), h:R n ^R d ^ 

where x is a state vector and u is a function of which the range is in M m . What information 
about the system should be made available in order to be able to derive a feedback 
u(h(x),t) that renders the solutions of Q converge to zero asymptotically? The question 
has been answered answered in [3], [H]. In short, it was shown that 1) if g(x, t) is bounded, 
2) there exists a matrix K G Qk C M mxd such that the zero solution of 

x = f(x, t) + g(x, t)Kh(x) 

is exponentially stable, and the bounds of Qk are known, then the feedback 

u = /3(y(\))h(x), 
\=\h(x)\>, 

1 A collection Us of all neighborhoods of S is called a neighborhood system of S. An arbitrary subcol- 
lection Bs C his is a fundamental base of system Us iff every neighborhood V G Us contains at least one 
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where /3 : R — > M mxd is a dense trajectory in Qk C R mxd and 7 : R — > R is a function 
that grows sufficiently slow, ensures that lim^oo x(t) = 0. Notice that despite trajectories 
x(t) converge to the origin asymptotically, solutions of the extended system (OQ), (TSJ) are 
no longer uniformly asymptotically stable. 

Example 2 Adaptive observers for systems in non-canonic adaptive observer form. Sup- 
pose that the following system be given 

n 

xi = (p 1 (y,t) T 9 1 + 2jxj + u(t), 
i=2 

Xi = -pi-iXi + <pi(y, t) T 9 h i = 2, . . . , n, pi E R >0 
y= (l,0,...,0) T s, 

where p = (pi, . . . ,p n -i) E R™ -1 , 6>j = col^i, . . . , 9i tm ) are the vectors of unknown of 
unknown parameters, functions <pi : R d x R — ► R m , k : R — ► R™ are known functions. 
The problem is to infer the values of Pi, 9^ from the values y(t). Standard Lyuapunov- 
functions based techniques for estimating the values of p iy 9 iy e.g. [9], do not apply here 
because system (|3]) is not in the canonical adaptive observer form (see pQ, [8] for details). 
Yet, trading Lyapunov stability for convergence, allows to solve this problem. It has been 
shown in [23] , [18] that there exists an estimator such that the dynamics of the extended 
system satisfies 

z = A(t)z + g(z,p,t)-g(z,P(\),t), (3 : R - R"" 1 

(4) 

A = 7 ||(l,0,...,0) T z|| £ , 7 eR> , 

with = A(t)z being uniformly asymptotically stable, g(z,(3(X),t) being glob- 

ally Lipschitz in A respectively, and ||s|| e = \s\ — £ for \s\ > e and ||s|| e = for 
\s\ < e. In particular, e(t) = z(t) — x(t) converges into a small neighborhood of the 
origin as t —>■ 0. Furthermore, for any e > there exists an interval (0, 70(e)] such that 
limsup^ \\P(\(t)) -p\\ < 5(e), 5 e K for all 7 E (0, 7o ]. 

It is easy to see that the invariant sets of (j3J) may not be uniformly asymptotically 
stable in the sense of Lyapunov. At the same time they are, as shown in |21j, weakly 
attracting. As is mentioned in [TTJ, control and estimation strategies similar to those 
presented in ([TJ-fll]) can be viewed as a prototype for any pre-routing scheme in the 
domain of supervisory control. Hence understanding their limitations and capabilities is 
important for further progress in this filed as well. 

In all these examples asymptotically stable motion in a high-dimensional subspace is 
coupled with unstable explorative motion in a low-dimensional subspace. Even though 
solutions of these systems of ODE may not be stable in the sense of Lyapunov, they 
asymptotically converge to the required domains. Notwithstanding the relevance of such 
systems for modellingQ, control and identification, there are limitations restricting further 
progress in application of the broader concept of unstable convergence to these areas. 
Among these, from the authors point of view, is the lack of a simple analogue of the 
Lyapunov method for these, strictly speaking, unstable systems that would allow to draw 

2 Here we would like to refer to [TH], P~5] where dissipative saddles are used to model decision-making 
sequences. 
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conclusions about asymptotic properties of unstable solutions without the need of solving 
the equations. 

Presently available techniques, such as e.g. non- uniform small-gain theorems [22], 
require existence of input-output gains for the stable subsystem. This condition, however, 
is already violated for simple cascade structures such as 



preventing the application of this theory. These techniques require knowledge, or at least 
estimates, of convergence rates for the stable component at A = [22J. Regarding the 
proofs of convergence in pE], they are of existential nature and also involve availability 
of the estimates (bounds) of the system solutions as functions of time. Moreover, as the 
authors of [I] comment, the results may not be of practical relevance in applications. 
Furthermore, they do not apply to system ([5]) for the term x\\ is not globally Lipschitz 
in x\. Hence, developing novel methods to address the issues of convergence to unstable 
sets is needed. These methods, on the one hand, should inherit the efficiency of Lyapunov 
analysis in which boundedness of trajectories can be verified by checking a system of 
inequalities without involving prior knowledge of the solutions of the system. On the 
other hand, these methods should apply to systems with instabilities. In our present 
contribution we provide a set of results that can be considered as a possible candidate. 

We consider a class of systems which can be viewed as a generalization of (0Q)-(l5]). 
We chose this class of systems for its relevance in applications ranging from nonlinear 
regulation in control to the problems of modelling decision-making in neural systems. 
Since we are interested in the solutions that are not necessarily stable in the sense of 
Lyapunov we abandon the concept of neighborhoods from standard Lyapunov analysis 
[TJ, [21]. For a given invariant set S of a system, instead of searching for a fundamental 
base of positively invariant neighborhoods of S, we study existence of an associated with 
S collection of positively invariant sets. These sets are not necessarily neighborhoods, 
and they are not required to form a fundamental base. In particular, the sets are allowed 
to be closed, and their boundaries may have non-empty intersections with S. 

For the chosen class of dynamical systems we formulate Lyapunov-like conditions 
that allow to specify the domains of positive invariance containing Lyapunov-unstable 
equilibria on their boundaries. In the classical method of Lyapunov functions the role 
of a Lyapunov function is to assure that an invariant set, e.g. an equilibrium, has a 
fundamental base of positively invariant neighborhoods. In our work we use an extension 
of this method in which a substitute of a Lyapunov function is used to demonstrate 
existence of a family of positively invariant sets (not necessarily neighborhoods) associated 
with the equilibrium. These results allow us to estimate the domains of initial conditions, 
as functions of system parameters in problems (ETJ) — (EJ) , that lead to bounded solutions 
without the need to know convergence rate of the stable part of ([I])-©. Parameters 
of these systems are not required to be known precisely, and input-output gains of the 
systems need not to be defined. Furthermore, in contrast to our previous results on the 
same topic [22], present conditions allow to specify domains of initial conditions that lead 
to trajectories necessarily escaping a neighborhood of the equilibria in question. 

The paper is organized as follows. In Section [2] we formulate the problem and specify 
main assumptions in detail. In Section [3] we provide main results of the paper, and Section 
|4] contains brief discussion and conclusions. The following notational conventions are used 



xi = 



A 



— kx\ + x\\ 
-ix\ } fc,7 G JR >0 , 



(5) 
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throughout the paper: symbol C k denotes the space of functions that are at least k times 
different iable; || ■ || stands for the Euclidian norm, V denotes the class of positive-valued 
continuous functions p : M>o — > R>o such that p(0) = and p(s) > for all s > 0; /C 
denotes the class of all strictly increasing continuous functions k : M>o — > R>o such that 
k(0) = 0. If, in addition, lim^oo k(s) = oo we say that k G K,^. 
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2 Problem Formulation 

Consider the following system: 

x = f(x,X,t) 
A = g(x,X,t), 
where the functions 

/ : R n x R x R -> R n , 
3:l"xExl^l 

are continuous and satisfy Assumptions [TH2] below. 

Assumption 1 The function /(•,-,•) (TJJ) «s locally Lipschitz in x and A uniformly in 
t, and there exists V : R n ^ R, V <E C 1 such that 

a(IMI) < V(x) < a(\\x\\), a, aGlC M 

f)\f (7) 
— f(x,X,t)<a(V(x))+(3(V(x)M\X\), a,(3eC°, <p e JC. 

Assumption [1] holds, for example, for those systems in which the term (dV /dx)f(x, A, t) 
can be bounded from above as follows: 

dV 

-fcf&^t) < -M\M)+Po(M\M\x\), a ,p e JC. (8) 

Indeed, ((7|) follows immediately from (El) with a(-) = — ao(o; _1 (-)), = Poi^T 1 {')) , 
and p. _1 (-), are the inverses of «(■), a(-) respectively. Notice also that in this case 

Assumption Q] states that the origin of x — f(x,0,t) is globally stable in the sense of 
Lyapunov, and V is the corresponding Lyapunov function. Even though the right-hand 
side of ([6]) is allowed to be time- varying, we restrict our consideration to systems for which 
the function V does not depend on time explicitly. 

Assumption 2 The function g(-,-, •) in is locally Lipschitz in x and A uniformly in 
t, and there exist 8, £ G K such that the following inequality holds for all x G R n , t G R: 

A|)- 5{\\x\\) < g(x, X, t)<0VA>0. (9) 

Assumption [2] reflects the fact that derivative A does not change sign for all A > 0. 
Without loss of generality we consider the case when A is non-increasing with time, and 
alternative formulations of our conclusions are available if (Q is replaced with 

< g(x, A, t) < 5{\\x\\) + £(|A|) V A < 0. (10) 

We aim to formulate a set of conditions that would allow us to estimate domains 
of positive invariance of ([6]) and specifically those in which the solutions of remain 
bounded. These conditions are provided in the next section. 
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Figure 1: Illustration of the proof of Lemma [TJ Panel a: boundary A = ip{V). The 
vector (dip/dV, —1) is a normal vector to the curve A = ip{V) at the point A. Because 
dijj/dV > it is always pointing in the direction of A < ip(V). Panel b: boundary 
A = const. Because A < for all A > the vector (dV, dX) is pointing in the direction of 
A > ip(V). 

3 Main Results 

We start with the following lemma 

Lemma 1 (Boundedness 1) Let system be given and satisfy Assumptions [21 
Suppose that there exist a function 

ip: i) G K. n C 1 
and a positive constant a G M>o such that 

&i/>(V) 
dV 

Then the domain 



a(V) + P(y)<p(iP(V))] + 6 {a-\V)) + £ ty(V)) < 0, V V G [0, a]. (11) 



Q a = {(x, A) | x G R n , A G M> , ip(a) > A > ip(V(x)), V(x) G [0, a]} (12) 
is forward invariant with respect to and furthermore 

3 A' G [0,V(o)] : lim X(t) = A', (13) 

t— >oo 

lim \\x(t)\\ = 0. (14) 



t— too 



Proof of LemmaUl The main idea behind the proof is as follows (see also Fig. [T]). Consider 
the surface 

A = ip{V{x)). 

The surface splits the system's state space into two domains: A < ip(V(x)) (white area in 
Fig. [[]) and A > i/;(V(x)) (gray area in Fig. [T|). Let us pick a non-empty interval [0, a], 
a G !R>o and set < A(to) < ip(a). Then V(x(t)) and X(t) remain in Q a specified by ([121) 
(gray area in Fig. [T]) if the right-hand side of 

dV 

A = g(x,X,t) 
6 



is pointing inside the domain A > if)(V(x)) for all V G [0, a], A = 4>(V). According to 
the assumptions, function ip G /CflC 1 , i.e. it is increasing and continuously differentiable. 
Hence the vector (dip/dV, —1) is (locally) orthogonal to the curve A = ip(V) for all V > 0. 
Therefore the fact that the dot product (dip/dV, —l)(dV, d\) T is non-positive at A = ip(V), 
V G [0, a], or alternatively, that the following condition holds: 



< 0, V V G [0,a], (15) 



suffices to guarantee positive invariance of fl a - The latter property together with (JTj) 
automatically implies that ||x(t, xo, Ao) || < « _1 (a), |A(t,xo, Ao)| < VK a ) for all (xo,Aq) G 

According to Assumptions [U [2} taking into account that ip, (p, 5, £ are non- decreasing, 
and noticing that A = ip(V(x)) > for all V(x) G [0, a] we have: 



X=V(V(a:)) OV ra 



< % HV{x)) + (3(V(x)M\X\)} + 5(\\x\\) + £(|A|) 



\=i,(V(x)) 

(16) 



< HV(x)) + P(V(x))^(V(x)))) + tfCa-^Cx))) + mV(x))) 

Hence ( ITT!) implies that ( |T5l) holds, and boundedness of x(t, xo,\q), \(t,xo,\o) for all 
(x , A ) G fi a follows. 

Property (fl3j) is immediate consequence of Bolzano- Weierstrass theorem, and (fHI) 
follows from Barbalat lemma. □ 

Remark 1 The conditions of Lemma [T] imply that ip(V) is non- increasing with time. 
Hence dip{V)/dt < for all V G [0, a] may serve as a necessary condition for the positive 
invariance of Q a . 

Example 3 Let us illustrate the lemma with deriving the domains of positive invariance 
for (JSJ). As we mentioned earlier, the first equation in ([5]) does not have finite input- 
output gain with respect to the input-output pair (xi, A). Hence neither of the approaches 
presented in |3], [22j apply. We shall show now that Lemma [Hallows to determine domains 
of initial conditions for §5§ corresponding to bounded solutions without invoking a finite 
input-output gain requirement. 

In order to apply Lemma [1] we need to check Assumptions [1] and [2j Assumption [1] 
holds for © with V = x\ } a(V) = -k2V, (3{V) = 2V 3 ' 2 , p(|A|) = |A|, and Assumption M 
holds with 5(|| x ||) = jx 2 and £ = 0. Now we need to choose a candidate for ip(V). For 
simplicity, let 

tP(V)= P V, P eR >0 . 



With this function condition ffTTj) reduces to the following constraint 

-2kp + 2p 2 V 3/2 + 7 < V V G [0, a] 

This constraint is satisfied for all V G [0, a] with a defined as: 

1 / \ \ 2 /3 

1 I, 7 \ \ ^7 
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Figure 2: Domain of positive invariance for (jSJ). Gray area shows the union of domains 
£l a (p) for all p > ^r. Examples of elementary Q a (pi), p\ = 0.3, P2 = 3, p% = 20 are 
depicted as shaded areas. 

Hence domains of positive invariance for (jHJ) shall contain the following union of cones 
U p >_l |fi a (p) = {(a:i,A) | A >p|xi| 2 , 0< < Q (k - ' } 

For 7 = 0.1 and k = 1 this union is depicted in Fig. [2] □ 

Remark 2 Lemma [1] requires that function ip(V) is strictly increasing in V and differen- 
tiable. In principle, one can remove this restriction by considering ip(V) as a piece-wise 
monotone function and replacing ffTTl) with a set of similar inequalities for each segment 
of monotonicity. The only difference would be that the sign of these inequalities will 
have to vary depending on the type of monotonicity of ip(V) in the segment (i.e. increas- 
ing/decreasing). 

As for the requirement of differentiability, it can be removed if we use a slightly 
different argument for establishing existence of the domains of positive invariance. The 
argument involves a notion of a star shaped domain. Formal definition of this and other 
related notions, and basic properties of star shaped domains and functions are provided 
in Appendix. 

Let us remind that a domain Q C M. n is called star-shaped with respect to the origin if 
every segment connecting the origin with i6(] lies entirely in Q. Clearly star shapedness 
of a set is a weaker property than convexity, and our statements involving the notion of star 
shapedness should hold if "star shaped" is replaced with "convex" in their formulations. 
A star shaped envelop of a set D (w.r.t. the origin) is a minimal star shaped set (w.r.t. 
the origin) including D. This set is denoted as: 

sta.i x (D). 

The epigraph of a function / : MJ 1 — > K, or simply epi(/), is the domain in R n+ : epi(/) = 
{x G M n ,fi G E| f(x) < //}. A function / : W L — ► K is called star shaped with respect 
to the origin iff its epigraph is a star shaped domain with respect to the origin. Convex 
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Figure 3: Deriving conditions of positive invariance for the domains bounded by non- 
different iable functions A = ip(V). In this case the fact that the epigraph epi^) of 
the function ip{V) over [0, a] is star-shaped with respect to the origin and that r(t) is 
non-increasing ensure that trajectories V(x(t)), X(t) will not pass through the boundary 
A = if)(V). Star-shapedness of the epi('0) is needed to guarantee that the vector (V(ti) — 
V(t 2 ),A(ti) — A(t 2 )) points in the direction of ip{V) < A for all points on the curve 
A = if)(V), V G [0, a]. Notice that this condition does not hold for the point B. 



envelope of a function / is denoted as conv(/)(x) and star shaped envelop of / (w.r.t. the 
origin) is denoted as star(/)(x). In addition we define 

epi(/[o,a]) = {(x,n) | x G [0, a] n , \i G R, f(x) < //}, 

the epigraph of the restriction of / on the hypercube [0, a] n , and consider convex and 
star-shaped envelops of such restriction: 

conv(/[ 0> o])(aO = inf{/i | G conv epi(/[ 0)O ])} 

star(/[ 0>a ])(x) = inf{/i | (x,/i) G star epi(/[ , o ])}. 

In order to derive domains of positive invariance of which the boundaries are not 
necessarily differentiable curves we use the following strategy. Instead of searching for the 
domains in which the dot product (dip/dV, —l)(dV, d\) T is non-positive we search for an 
interval [0, a] such that the epigraph of ip for V G [0, a]: 

epi(V[ ,a]) = {(V,A) | V G [0,a], A G M> , VW < A ) 

is star-shaped with respect to the origin, and ratio V(x)/X is not-increasing in forward 
time for all V G [0, a], A = ip{V) (see also Fig. [3]). In other words 



d_ (V 
It IX 



< 0, Vy G [0,a]. (17) 

X=i,{V) 



Inequality ( fT7j) implies that the curve A = ip(V) "shrinks" locally in the direction of 
V = for every pair (V, A), A = ip{V), V G [0, a}. Hence trajectories V(x(t)), A(t) passing 
through Q a at t — to will remain there for all t > to. Therefore the following statement 
holds. 
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Lemma 2 (Boundedness 2) Let system be given and satisfy Assumptions [21 [B 
Suppose that there exist a function ip : R — > R ; "0(0) — 0? anc ^ a positive constant a e M>o 

V(V) [a(V) + f3(V)(p(ip(V))) + V[6 (of X (V)) + £ (VW)] < 0, V V e [0, a], (18) 

and epi( , 0[o 1 a]) is star-shaped with respect to the origin. 

Then domain {Tty) is forward invariant with respect to (0|) ; and furthermore properties 

(ED, g hold. 

Proof of Lemma [E The proof is straightforward and follows from (ITTj) . Inequality (ITTj) is 
satisfied if 

VX — XV = i/j(V)V - XV < 

On the other hand, similar to ( TloT) . the following estimate holds: 

Therefore, Q(V(x)) < d/dt (V/X) < at A = ^{V). The remaining part of the proof 
is identical to that of Lemma [TJD 

Remark 3 The major difference between Lemmas [1] and [2] is that the partial derivative 
dijj/dV in (fTTj) is replaced with the ratio i()(V)/V in the conditions that follow from (fl8|) . 
In case of linear functions i/> = pV these lemmas will produce identical estimates of the 
domains of positive invariance. In the nonlinear case Lemma CD allows to take the local 
structure of ip(V) into account while Lemma [2] does not. The price for this benefit is the 
required differentiability of ip(V). 

Remark 4 Lemmas [1] and [2] establish criteria for existence of positively invariant sets 
in the state space of (jSJ) in terms of the properties of functions f(x,X,t) and g(x, X,t). 
In control problems the function f(x,X,t) defines a controlled dynamical system, and 
g(x, X,t) describes tuning mechanisms of the controller (see, for instance Examples [T], [2]) . 
It is therefore important to know if, for a given controlled system 

x = f(x,X,t), 

where A is the controller parameter, one can determine a tuning algorithm 

X = g(x,X,t) (19) 

ensuring existence of the domains of positive invariance corresponding to the bounded 
solutions in forward time. Results are available for the functions f(x, A, t) that are globally 
Lipschitz in A uniformly in £ [1], [22]. Lemma [2] allows to demonstrate that it is possible 
to derive tuning algorithms (fT9~|) ensuring existence of the domains of initial conditions 
that correspond to bounded solutions of flS]) in which the right-hand side is only locally 
Lipschitz in A. In particular, the following Corollary holds. 
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Corollary 1 (Existence) Let the following system be given, 



x = f(x, A, t) 

(20) 

A = u, 

where u is a control input, and the function / : R" x 1 x R ^ 1" satisfies Assumption^ 
with <£>(-) being locally Lipschitz, and a(-) = —ao(-), «o £ V . 

Then there exists a continuous function g(x, X,t) : 1" x R x I ^ 1 and a domain Q a 
with non-zero volum^ such that all solutions of fifty) passing through Q a are bounded in 
forward time and, in addition, satisfy fTty) , [L4\ ). 

Proof of CorollaryUl Let S (a) denote a class of functions from V such that their restriction 
to [0, a] is star-shaped. According to Lemma [2, existence of functions ip(V) G S(a), 
7(V) G V such that the following inequality holds 

i>(V) [-a (V) + (3(VM^(V))} + Vj(V) < 0, V V G [0, a], a G R >0 (21) 

constitutes the proof. Let us show that for any function f(x,X,t) in (1201 satisfying the 
assumptions of the corollary there will always exist functions ip(V) G <S(a), j(V) G V and 
a G M>o such that inequality (I2~T1) holds. 

First, we notice that a product of two functions from V belongs to V . Hence we can 
always choose the function 7(V) in the following form j(V) = ip(V) , ~fQ(V), where 7o(-) is 
some function from V. Taking into account that the function ip(V) is locally Lipschitz 
and that /3(V) is continuous we can observe that for any a G M>o there exists a positive 
constant D(a) G M>o such that 

(3(V)^(V)) < D(a)4)(V) V V G [0,o]. 

Therefore all we need to show is that for some a G IR>o there exist i/j(V) G S(a), 'joiV) G V 
such that the following inequality holds: 



Choosing 



- a (V) + D{a)ij{V) + a lo {V) < 0, V V G [0, a]. (22) 

and taking (I22p into account we obtain the following inequality 

- l -a,{V) + D(a)i/>(V) < 0, V V G [0, a]. (23) 

Therefore the corollary will be proven if we demonstrate that for every rj(V) G V there 
exists a star-shaped ip(V) G V and a G M>o such that 

r](V) > ip(V) V V G [0,a]. 

Existence of such function ip(V) is guaranteed by Proposition [TJ 



3 In fact we show that Q a can be determined as in (|12p where ^i(-) is a function from and a is a 
positive number. 
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According to Proposition [TJ for every rj(V) G V there exists star(77[o, a ])(:r). The func- 
tion star(?7[o ia ])(x) is a continuous and monotone function, and it is a minorant of r\{x) on 
[0, a]. Hence choosing either 

if>(V) = star (^j^y«o [o,a]j (Y) 

or 

if>(V) = conv (^^y"o [o,a]j (V) 

we ensure that (I23p holds with a star-shaped ip(V) from P. Thus the corollary follows 
immediately from Lemma [2j □. 

Let us illustrate the utility of Corollary [1] with the following example. 

Example 4 Consider the following nonlinear local regulation problem in presence of para- 
metric uncertainty. Suppose that the system equations are defined as 

x = - K (x) + {x 2 + l)f{x,0) +u, (24) 

where 

{1, x > 1 
x 3 , x G [—1, 1] 
-1, x < -1 

f(x, 9) is a Lipschitz function with respect to 9: 

\f{x,e)-f{x,e')\<D\e-e% 

and 9 is an unknown parameter from R. The question is wether for some interval Qg G R 
there exists a compensating feedback 

u (ar,0) = -(x 2 + l)f(xj) 
§ = g{x), geC 1 

and a domain of initial conditions, Q x , with positive measure such that trajectories x(t) 
of fT24]) passing through fi x converge to the origin for all 9 G 

Notice that because the zero solution of x = —k(x) is not exponentially stable we 
cannot apply conventional theorems from the domain of output regulation [2]. Yet, as 
follows from Corollary [T] such feedback indeed exists. In order to see this consider the 
following functions V(x) = l/2x 2 , A = 9 — 9. Clearly, Assumption [1] is satisfied for (1241) 
with 

a (V) = k{VV2)^{V)2, (3{V) = 2DVv(2V + 1), 

and ocq(V), (3(V) G V. Hence for any 9 there exists a domain Q a (9) with nonzero volume 
such that solutions passing through Q a (9) have the desired property: lim 4 ^ 00 x(t) = 0. 
The intersection of Q a (9), 9 G Q$ is a non-empty set with nonzero volume provided that 
Qg is sufficiently small. 

The control scheme in example H] can be generalized further to constitute an existence 
result to the problem of local nonlinear adaptive regulation. This simple generalization 
is provided in the next corollary. 
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Corollary 2 (Local adaptive regulation) Consider the following system 

x = f(x,9,t) +v, (25) 

where f : R™ xtxl-> R™ is a continuous function that is Lipschitz in 9 locally in x 

\\f(x,9,t) - f(x,9',t)\\ < D(\\x\\)\9 - 9'\, D g K 

and v is a control input defined as 

v = -f(x,9,t) + f (x). 

Suppose that fo(x) is a continuous vector-field such that the origin of x = fo(x) is globally 
asymptotically stable in the sense of Lyuapunov. 
Then there exists a tuning algorithm: 

§ = g(x), g(x)eC° (26) 

and a set of initial conditions fl a with non-zero volume such that for all 9 G [a, b] 

1 ) solutions of p?3j) . (2b]) passing through Q a are bounded 

2) x(t) is asymptotically stirred to the origin: Hindoo ||x(t)|| = 
provided that [a, b] is sufficiently small. 

Remark 5 Solutions to the local adaptive regulation problem have been already dis- 
cussed in the literature, e.g. in the framework of robust output regulation [2J. These 
results, however, require that the origin of x = fo(x) is exponentially stable. Our present 
conclusions demonstrate that for a general class of systems, existence of an asymptotically 
stabilizing feedback suffices to show existence of an adaptive controller solving the prob- 
lem of regulation locally in the presence of locally Lipschitz nonlinearly parameterized 
uncertainty. 

Next, we characterize the domains of initial conditions corresponding to solutions that 
do not converge to the origin. These domains are provided in the following lemma. 

Lemma 3 (Solutions escaping the origin) Let system be given and satisfy As- 
sumptions [21 [3 Suppose that there exists a function 

and a positive constant a G R>o such that for some e G R>o the following holds 

[a(V) + /3{V)<p(rl>{V) -e))+6 {gT^V)) + £ &(V) - e) > V V G [0, a] (27) 
Then the domain 

tt a = {(x, A) | x G R n , A G R, A < ip{V(x)) - e, V(x) e [0, a]} (28) 

is forward invariant with respect to In other words, solutions of (TJJ) passing through 
Q a do not converge to the origin. 
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Figure 4: Illustration to the proof of Lemma [31 Panel a: boundary A = ip(V) — e. Vector 
(dip/dV,—l) is a normal vector to the curve A = ip(V) — e at the point A. Because 
di/j/dV > it is always pointing into the direction of A < ip(V). Panel h: boundary 
A = const. Because A < for all A > vector (dV, dX) is pointing into the direction of 
A > ip(V). 



Proof of Lemma is analogous to that of Lemma [T] except that constraint A = ip(V(x)) 
is replaced with 

\ = 1>(V(x))-e, 
and the sign of (|T5l) should be reversed (see also Fig. [4j. □ 

Example 5 Let us illustrate the lemma with system (jSJ). Choosing the same functions V 
and ip{V) as in Example [3] we can rewrite inequality ([27)1 as follows: 



- 2kp + 2pV 1/2 {pV - e) + 7 > V V e [0, a] 



(29) 



The term 2pV l/2 (pV — e) is bounded from below by — 4/3a/£ 3 p/3. Hence condition (1291 
will be satisfied for all V > if the values of p are chosen to obey the following inequality 



-2kp - 4/3^/^3^ + 7 > 0. 
Thus solutions passing through the following domain 



/ 



A < p|a;i| 2 — e, p £ 
will not converge to the origin. 



0. 



+ 87A: - | ■ ; 



27 



4k 



So far we have established conditions that allow to derive Lyapunov-like characteriza- 
tions of the domains of positive invariance for ([6]). These conditions do not require a-priori 
knowledge of the system solutions, nor they require estimation of an input-output gain 
of the stable part of the cascaded system. As we have seen, e.g. in the case of Lemma 
[U the final shape of the domain of positive invariance can be estimated as a union of pa- 
rameterized families of cones (see Fig. [2j. Furthermore, these estimates can be obtained 
even for systems with finite escape time. 
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An important question remains: how good are these estimates in comparison with 
that of [22], [I] derived for the same problems. In order to answer this question consider 
the following subclass of (jSJ) to which the results of [22], [I] apply: 



(30) 



x = f(x, t) + b(x, A, t) 
A = -7IMI, 7 € K >o 

Functions / : R" x 1 -» R™, b : R n x R x R -» R n , q : R" x R x R -» R" in (|30l) are 
assumed to be continuous; the function b(x, X,t) is Lipschitz in A: 

\\b(x,X,t)-b(x,X',t)\\ <B\X-X'\ (31) 

with b(x, 0, t) = 0. For simplicity, suppose that there exists a quadratic Lyapunov function 

V(x) = x T Px } P = P T > 0, p\\x\\ 2 < V(x) < p\\x\\ 2 , \\Px\\ < a\\x\\, p,p G R >0 

such that 

^^-f(x,t)<-kV, keR >0 . (32) 

We will assume that the values of p, p, k, and a (maximal eigenvalue a of P) are known. 
Then domains of initial conditions corresponding to bounded solutions of (|30|) are specified 
in the following corollary from Lemma [1] 

Corollary 3 (Non-uniform small-gain condition) Let system K3(J\) be given and as- 
sumptions {HP, {HP hold. Then solutions of ( fffSj) passing through 



n' a = {(x,X) I x G R n , A G R, A(t ) > \\x(t )\\ky/pp/(4(TB)} 
are bounded and remain in 

Vl a = {(x,X) I x G R n , A G R, A(t ) > ||x(t )||W(4a5)} D fi' a 
provided that 7 zs sufficiently small: 

7 < - f Vl ■ (33) 
f 16 \gB) v 7 

Proof of Corollary [3 In order to apply Lemma [1] we need to check Assumption [1] and [2j 
The first inequality in Assumption [1] clearly holds with 

a(||a;||) =p||a;|| 2 , a(||x||) =p||x|| 2 . 

In order to check that the second inequality holds consider 

^(f( x ,t)+b(x,X,t)) < -kV + 2\\Px\\\\b(x,X,t)\\ < -kV+fapj W\X\ (34) 

Hence the second inequality of Assumption [1] holds with 

2aE 
VI 



a(V) = -kV, (3{V) = cVV, c = I 1 , (p(\X\) = \X\ 
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Assumption [2] holds with <5(||x||) = 7||x|| and = 0. According to Lemma UJ we 

need to find ipiV) such that (jTTl) holds. Then the domains of positive invariance and 
boundedness of solutions are determined by (1121) . Let us choose 



ip{V) = Wr, r G R >0 . 

In this case (fTTI) transforms into: 



r-^=(-kV + cWrW) + — W = — ( -kr + cr 2 + — ) < 0, (35) 
and choosing 

7 < ^= (kr — cr 2 ) (36) 

ensures that (fTTI) is satisfied for all V. Optimizing the right-hand side of fl36|) for r we 
obtain that the maximum is achieved for r = kj (2c). Hence, the condition 



7 < o 



1 ^/pk 2 _ l pk 2 



8 c 16 aB 

ensures that (1551) holds, and that the solutions of (1311 passing through 

n* a = {(x, A) I x G R n , A G R, A(t ) > v / ^(^(^o))A; v ^/(4a J B)} 



are bounded and remain in fi*. Given that -/p||a;(to)|| < < v /p||x(t )|| we can 
conclude that 

Q' a = {(a;, A) | x G R™, A G R, A(t ) > |K*o) \\k^/pp/(4aB)} C fi* 

and 

fi a = {( X ,A) | i G 1", A G R, A(t ) > ||x(t )||A;p/(4(7S)} D 0* 
Hence solutions starting in Q' a will remain in fi a . □ 

We illustrate with the next example, the bounds for 7 established in Corollary [3] can 
be substantially less conservative than those provided by the small-gain theorem [22] for 
the same system. 

Example 6 Consider the following cascaded system 

Xx = -T1X1 + C1X2 

x 2 = -c 2 \x 1 \, Tl, Cl, C 2 G R >0 . 



According to Corollary 4.1 from [22J the following choice of system parameters ensures 
existence of initial conditions corresponding to nontrivial bounded (in forward time) so- 
lutions: 

< c 2 < — -i. 38 
16 Ci 

Now we will use Corollary [3] to estimate the bounds for c 2 that guarantee existence of 
nontrivial bounded solutions. As a Lyapunov candidate we chose V(xi) = x\. Hence 
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k = — 2ti, a = 1, B = c\, p = p = 1. Then, according to Corollary [3] the following 
inequality guarantees existence of nontrivial bounded solutions for (!37j) : 



< c 2 < 



Ml 



4ci 




The domain of admissible values for c 2 that follows from Corollary [3] is four times larger 
than that specified by (|38|) which is based on the non-uniform small-gain theorem. This 
illustrates that our present result is less conservative for the problems of this class. 

4 Discussion and Conclusions 

In this brief manuscript we provided further results that allow to address the issue of 
positive invariance and convergence for a range of problems in control and in the broader 
domain of dynamical systems. In particular, we considered systems in which stable mo- 
tions in higher dimensional subspace of the system state space are coupled with unstable 
motions in a lower dimensional subspace. The main motivation is to go beyond current 
restrictions of convergence results in [22], [I] and provide an analysis method for a relevant 
class of systems with unstable solutions. 

The results we provided do not require (partial) knowledge of the system solution; 
they do not assume availability of input-output gains and estimates of contraction rates 
for the stable parts of the system. The advantage of our method is that it has the flavor 
of simplicity inherent to conventional Lyapunov-based analysis. Furthermore, the bound- 
edness/unboundedness criteria have similar shape with that of the celebrated Lyapunov 
stability/instability conditions. 

Our method allows to produce substantially less conservative convergence results than 
other available techniques such as [22J, [4J. We illustrated this possibility with a simple 
example. Availability of these less- conservative estimates is advantageous in parameter 
estimation problems [2TJ, [20] for in these applications the upper bound for 7 determines 
the maximal speed of exploration in the space of parameters. The higher the speed, the 
better the overall performance. 

In addition to the boundedness criteria, geometric intuition behind our results allows 
to estimate the domains of initial conditions corresponding to solutions which necessarily 
escape a given small neighborhood of the origin. These results can be applied to the 
problem of estimating relaxation times in dynamical systems [3]. 
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5 Appendix. Star-shaped sets and envelopes 

Convex analysis is a well known and widely used subject in the domain of optimization 
|17j . In contrast, the idea of star shaped functions is not so well known. Here we provide 
a list of definitions and properties related to the notions of convexity and star-shapedness 
that are referred to in the main text of the manuscript. 

Let V be a real vector space. A closed interval [x, y] is defined as a segment connecting 
two vectors x, y G V: [x, y] = {72 + (1 — j)y | 7 G [0, 1]}. 

Definition 1 A set S C V is star shaped with respect to a point x G S, if for any y G S 
the interval [x,y] also belongs to S: [x,y] C S. 

The following properties hold for the star shaped sets in V: 

• A set is convex iff it is star shaped with respect to its every point. 

• Let x G V and W be a family of star shaped sets with respect to x. Then both the 
intersection HsewS of sets from W and the union Us^wS of sets from W are star 
shaped with respect to x. 

• Let E be a real vector space, A : V — > E be a linear map, and S C V be a star 
shaped set with respect to a point x G S. Then the image A(S) of A is star shaped 
with respect to A(x). 

Definition 2 For any set D C V and a point x G D the star shaped envelope of D with 
respect to x, star x (D) 7 is the minimal star shaped set with respect to x which includes D. 

Star shaped envelop exists and could be defined in two alternative ways. Namely, 
"from above" (as an intersection): 

star x (D) = P| S, 

SdW x (D) 
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where W X (D) is a family of sets that are star shaped with respect to x and include D, 
and "from below" (as union of intervals): 

S=\J[x,y). (39) 

yeD 

Notice that deriving a star shaped (w.r.t. a point) envelope of a set is a much easier 
procedure computationally than that of deriving a convex envelop of the same set. 

Let us remind that epigraph of a real valued function / : S — > R is a subset of S x R 
that consists of all points lying on or above its graph: 

epi(/) = {(z,7) I z € 5, 7 > f(x)}. 

Definition 3 A function f : S — > R zs star shaped with respect to x E S , ifepi(f) is star 
shaped set with respect to (x, f(x)). 

Clearly, S must necessarily be star shaped with respect to x. Alternatively, we can use 
the following definition. 

Definition 4 A function f : S — > R (on a star shaped set S with respect to x) is star 
shaped with respect to x iff the following holds for any y G S and every 7 G [0, 1]: 

f{ 1X + (1 - i)y) > 7 /(x) + (1 - 7 )/(j/). 

This is a form of Jensen's inequality with one "fixed end" . It is obvious that a function 
on S is convex iff it is star shaped with respect to every point x G S. 

Definition 5 Let f : S — > R be a bounded from above and below function (A < f{x) < 
B ). Supremum of star- shaped (with respect to x) minorants of f is the star shaped envelope 
of f with respect to x, star 3 ,(/). 

Let S C V be a star shaped set with respect to x G S. The following list of properties 
holds for the star shaped sets and functions: 

1. 

epi(star x (/)) = star^epi/). (40) 

2. 

conv(/)(y)<star,(/)(y)</(y). (41) 

The first property follows immediately from the definition, and the second property is a 
consequence of the following fact: 

epi(/) C epi(star a .(/)) C epi(conv a; (/)). (42) 



From the definition of a star envelope of a set from below (the last expression in (139]) ) 
we can produce the definition of a star envelope of a function. Let us start from ID case 
(i.e. V — R). Let S = [a, b], x G S. For any z G S (z 7^ x) we define 

Jnim{/(y),^/(x) + ^/w)ifO<^<l; 
<i>*M = { I z ~ x z ~ x J z ~ x (43) 

I f(y) else. 

As follows from the Jensen inequality with one fixed end, the following property holds 

star.,. (/)($/) = inf{0, x (y)} 

The following proposition is obvious: 
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Proposition 1 Let f : S — > R 6e a continuous function. Then the following properties 
hold: 

1) The functions 4> z ,p(y), P £ 5 are equicontinuous with f ; 

2) The set of functions {4> z , P (y)}, p & S is compact; 

3) The function star p (/)(?/), p E S exists and is a continuous function. 

4) If a continuous function on [a, b] achieves its minimum at a single point x, then its 
star shaped envelope with respect to x has the same property. 

5) The star shaped envelope (w.r.t. a point p G S) of a monotone function is monotone. 

The first property follows immediately from ( 1431) . Properties 2,3 follow from the 
Arzela-Ascoli theorem. Indeed, {(fi z , P (y)}, P £ S is pointwise relatively compact and 
closed. Hence, taking property 1 into account, we can conclude that the set of functions 
{(f> z ,p(y)} is compact. To demonstrate existence and continuity of star p (/)(y), p G S 
consider a sequence {g%\^x of grids $ = {a, a+ (b — a)/i, a + (b — a)k/i, . . . ,6}, 1 < k < i 
on S, and define 

fi(y) = inf {(j) r , P (y)} 

reg 2 i 

The sequence of functions {fi(y)}i=\ ■ ■ ■ is equicontinuous and fx > f2 > • • • > f n > 
pointwise. This means that the sequence converges uniformly, and that lmij^oo fi(y) = 
mi z£ s{4>z, P (y)} = star p (/)(?/). Property 4 is easily verifiable by the contradiction argu- 
ment. Property 5 is the consequence of that functions fi(y) are monotone by construction 
and are equicontinuous. □ 

Let V = R n , and S C V be a compact and star shaped with respect to x. For every 
z <E S, and 7 G [0, 1] we define 

^(7) = min{/((l - 7 )x + 72), (1 - l)f{x) + lf{z)}. (44) 

Then 

star x . (/)(?/) = inf Hz{y)}- 

The properties of function star x (f)(y) depend on the properties of mapping 

y >-> {(7, ^) I (1 - 7)^ + 7^ = y, 7 e [o, i], z e K}. (45) 

If this mapping is continuous (in the Hausdorff metrics in the space of compact sets), 
then the star shaped envelope of every continuous in S function with respect to x is also 
continuous. Mapping (j4"5l) is continuous in S iff the Minkovski functional 



p(y) = inf {a | y — x G a(S — x)}. 

a>0 



is continuous in S. 
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